FIG. 1 



SPEECH SYNTHESIS SYSTEM.110 

TARGET WORD SEQUENCE 



■120 



f 



130 



TARGET UTTERANCE 
PRE-PROCESSOR 



I 



150 



LINGUISTIC 
DATA 



— 122 
TARGET 

PRONUNCIATION(S) 
^—130 



I 



140 



CONCATENATION 
CONSTRAINTS 
AND COSTS 



UNIT SELECTOR 



SOURCE 
PRONUNCIATIONS 
AND 

SEGMENTATIONS 



- — 132 

TARGET SEGMENT 
SEQUENCE(S) 

160 



145 



WAVEFORM 
CONCATENATOR 



SOURCE 
WAVEFORM 
SEGMENTS 



^— 170 
TARGET WAVEFORM 



FIG. 2 



TARGET UTTERANCE ■■ 
PRE-PROCESSOR: . . 



id T'U. .'i /' J i'- / \ ii . 1 ' " i 



FORM WORD SEQUENCE 



APPLY LEXICON -FST' 
(WoL) 



230 



APPLY PHONOLOGICAL 
RULE FST, 
(WoLoP) 



♦ r 



225 



APPLY PRECOMPUTED 
LEXICAL/ PHONOLOGICAL 
FST 
Woopt(LoP) 



OPTIMIZE RESULTING 
FST (opt(WoLoP) 



240 



t 



UNIT SELECTION: 



-310} 



APPLY TRANSITION 
FST, ((WoLoP)oT) 



APPLY SYNTHESIS FST 
(WoLoPoT)oS 



320 



FIG. 4 



FORMING SYNTHESIS FST (S): 



f 410 -• 



FORM CONSTRAINT 
KERNEL 



v 



FORM PRONUNCIATION 

GRAPH FOR EACH 
SOURCE UTTERANCE 



LINK SOURCE 
UTTERANCE GRAPHS 
AND CONSTRAINT 
KERNEL 



420 



430 



FIG. 5 




CONSTRAINT KERNEL 



FIG. 6 



^ 510 

SOURCE UTTERANCES 




C 5 20' 



FIG. 7 



SOURCE UTTERANCES 



utt4: a:$7 aid, - S( d:$y. " ; 




522 



u ° ■ 

^INCOMING j 
LAYER 



RIGHT-CLASSED LEFT-CLASSED 
INCOMING I OUTGOING 

I TRANSITIONS j TRANSITIONS^ 

"~ ^ 534 X ' 



O 
O 



544 



OUTGOING 
__LAY_ER__| 



CONSTRAINT KERNEL 



FIG. 8 



SOURCE UTTERANCES : - ' 




o 
o 

'INCOMING 
_LAYER__ - 

i CONSTRAINT KERNEL 



522 



RIGHT-CLASSED 
INCOMING 
TRANSITIONS 



LEFT-CLASSED 
OUTGOING 
TRANSITIONS 



l _ __ _ _ _ _ _ _ _________ — 



o 
o 



ioutgoing! 

LAYER 



526i 



FIG. 9 

r SOURCE UTTERANCES 



Bosnia 




910 

r L 

' TARGET UTTERANCE 




.24 



% 

3 



M 

i 



4 



^3 



£ Li- 



's 

I 

.a - 



b0 

a 

s 

a 



•a 



CO 

13 



o 
T3 

X) 

> 



1 " ^ 

S 43 43 43 



I 



S <*> x 

*3 3 o? 

g -S ^3 43 

I 



8 5 g «£ 

to B co O to 




r— « 

0) 



5 

8 



I 

a 
■a 



CD 



43 



43 



43 



69 



u 

p. 
p. 

bO 



o 

43 



bO 



a 



3 



at 



•3 
3 



< 

CM 



LL 



-6 

43 

* -a 

t CO 
A •* 

75 73 73 | 
ja -d "ho " 

43 T3 hO S 



&i 
& § 



bO 

a 



43 



2 



0> 



? o o g « 

> cH co m co 



• * 



V ^ _ "1 _j _j 

5 S h 13 13 

3 § I 3 3 3 § 

J5 *a > fl fl a 43 



•y s 

a o 

43 A 



none 


o 
o 
o 

r-» 


o 
o 
o 

r-4 


o 
o 
o 

r-4 


o 
o 
o 

rH 


0001 


© 

o 

o 

rH 


o 

o 
o 

rH 


o 

o 
o 

rH ! 


o 

Hi 




0? 

1 


o 

£<* 
o 

eH- 


=1 


o 

rrt; 


o 
o 


o 
o 
o 

rH 


o 
o 
o 

rH 


O 

o 
o 

rH 


ooot 


1 Ot 


back 


O 

O 
O 


O 
O 
O 


O 
O 
O 


O 

o 
o 


o 
o 
o 


O 
O 
O 


O 

O 
O 


O 

rH 


I 0001 




f 

rO 


© 
o 

rH 


O' 

o 

rH 


O 


O 


O 
O 
O 
rH 


ooot 


1000 


o 

rH 


1000 


front 


ooot 


1000 


1000 


o 
o 
o 

r-4 


o 
o 

o 

rH 


O 
O 
O 
rH 


O 

rH 


o 
o 
o 

rH 


o 
o 
o 

rH 


> * * 1 1 


I 

-Si* 


o 

8' 


O 

8- 


to' 

s 




g 

O 


o 
o 
o 


o 

rH 


o 
o 
o 


o 
o 
o 


O) 


1000 


1000 


1000 


o 
o 
o 

r-4 


O 
O 

o 

rH 


O 
rH 


o 
o 

O 

rH 


O 
O 

o 

rH 


O 

rH 




f 


o- 
o 

rH 


or 
o 
o 

rH 


s 

o 

rH 


Oi 

o 
o 

rH 


o 
o 
o 

rH 


o 
l-t 


1000 


ooot 1 


| 1000 




1000 


1000 


o 
o 
o 

rH 


o 
o 
o 

r-4 


O 
rH 


O 

o 

o 

rH 


O 

O 

o 

rH 


O 

o 
o 

rH 


O 

o 
o 

rH 






1000 


O 
O 
O 
rH 


O 
O 

o 

rH 


o 
o 
o 

rH 


O 
rH 


1000 


1000 


1000 


1000 


s 


1000 


ooot 


1000 


o 

r-4 


1000 


1000 


1000 


1000 


1000 




£ 


1000 


1000 


1000 


O 
rH 


| 1000 


1000 


| 1000 


ooot 


1000 


velar 


1000 


1000 


o 

rH 


1000 


1000 


o 
o 
i— t 


1000 


1000 


1000 




velar 


1000 


1000 


o 

rH 


1000 


1000 


o 
o 


1000 


1000 


1000 


alveolar 


1000 


o 

r-t 


1000 


1000 


o 
o 

rH 


1000 


1000 


1000 


ooot 




alveolar 


1000 


o 

1—4 


ooot 


1000 


o 
o 

rH 


ooot 


1000 


ooot 


1000 


labial 


o 

r-H 


1000 


1000 


o 
o 

rH 


1000 


1000 


1000 


1000 


1000 




labial 


o 

rH 


1000 


1000 


o 
o 

rH 


1000 


1000 


1000 


ooot 


1000 




labial 


alveolar 


velar 


s 




O) 

a 


front 


back 


none 






labial 


alveolar 


velar ! 


a 


a 


9 


front 


back 


none 



CD 



I 



°- < 

f CO 



o 



a 

a 
-a 



o 
bO 

bO 

X 

id 

Xi 
•«— > 

xt 

>» ° 
O ^ 

§ « > 



<2 



s 

-3 



S3 ^ X> 



CO 

CO 



£1 



15 o 



o a) 

O +? 
co O 



03 



°-tLp' 

xi 



:t T 



O 



a ^ 
g Id 

Si 

p-i Xi 

>, 
0) 



go 

•s 

XI 
-♦-» 

Jd 
••—> 

Xi 
cj 

,x3 

N 

X\ 
CO 

N 

ot 

<— • 
u 



is § 
o> o 



1 

u 
O 



o 



o < 

o. $ 

rH i 

.-v > * 


3 < 


3 < 

3f 




O < 

o * 

rH 


o 1 


TV* 


o 


o 
o 

rH 


f 


©: 
o 


O 

o 

rH 


O 

r ^ 


o 

o 

rH 


o 

o> 

rH ? 

- 


O 

CP 
rH 


■8 
■8 

M 
•4-3 

CD 


a 

3 
o 
r4 


1 

M 
O 

a 
o 


o 




O 

o 


o 
o 

rH 


O 

o 

rH 


o 

rH 


o 
o 

rH 


o 
o 

rH 


o 

rH 


o 
o 

rH 


O 
O 
rH 


O 
rH 


O 

o 

rH 


O 
O 
rH 


O 
rH 


oot 


O 

o 

rH 


oot 


retrofiex 


round 


sonorant 


other 



Q 

CO 

(3 



O 

CO 



CO 



ft 

bO 

<v 



s 



< 



LL 



2 

=«= 

bO 

■ ' n- 



g 



o 

bO 
bO 
X 

^3 



o 

bO 
bO 
X 

73 



o 

cp cd 
a> cc3 

•a 9 

>> * 

" H X! 



CS3 

CO 
CS3 
CO 

73 



o 

§ > 

O a 
S3 ^ 



I - 

^ M O CP 

2 2? « o 



CP 

cd °3 



a3 
32 



S 

a; «3 

•a g 

^3 

• f-H 



«3 



0) 



H 8 o 



o 

CO 
CO 

73 

H- 3 



o 



a 
ft 



l 

CO 



CP 




CD 



T3 
d 

o 



o 

M 

CP 



1 



o 
43 



o 
o 
to 



o 
o 



o 
o 



o 
o 



o 



-3 



B 

o 



T3 

a 

S3 
O 



bther 


o 

1ST* J 


/ *«■) 

CT 
O 


h 

o 


o 
o 

rH 


o 
o 

iO 


o 

rH 


1 


o 
o 


o 

o 


o 
o 


O 
O 

uO 


o 

rH 


o 
o 
















and 


OOT 


o 
o 

r-H 


OOT 


O 
rH 


o 
o 


o 
o 

rH 


o 
u 














retroflex 


OOT 


o 
o 

rH 


o 

rH 


OOT 


o 
o 


o 
o 

rH 


back 


OOT 


O 
rH 


O 
O 
rH 


OOT 


o 
o 
m 


O 

o 

rH 


front 


o 

rH 


O 
O 
rH 


OOT 


OOT 


o 
o 


OOT 




front 


back 


retroflex 


round 


schwa 


other 



Q 

(3 



T 



ft 



faQ 
C 

C 

<D 

S 

B 

03 



< 
LO 



13 ° 
.3 



8" 



M O 

•g s 

•3-9 

•a -9 

tSJ 
CO 



I 
1 

a x 

1—1 

° ^ 



0) 

-«-» 

CO 

43 
O 



Pi 
O 

o 

CO 



LL 



a 

4? 



3 



CD 
lO 



I 



bo 
43 

T3 w x 

•— t i—l 

o u . 

,Q ft 



•a .8 

8 g 

O fl 

> 3 



M 
O 

a 
o 

CO 





o 


o 


o 


1 


o 


o 








/— \ 
w 




$-1 
o 




r-t 












o 








CO 








T) 










o 




© 


a 
















i 




















w 


o 




i— 1 


O 


o 


oic 




i-< 


o 












TJ 








0) 








u 












Pi 




o 




o 




> 




a 








o 






P 


CO 



Q 

LO 

O 

LL 





O 


o 


1 


o 


rH 




o 




s 






g 












CO 








o 


o 


1 




o 
o 


I 




r-i 








•§ 




















1 


1 










P 


Pi 




Pi 


O 




bst 


son 




o 



o 

LO 



LL 



